Skip to content

Docker: added build args for non AVX2 CPU#5154

Merged
oobabooga merged 19 commits into
oobabooga:devfrom
adamflorizone:main
Jan 3, 2024
Merged

Docker: added build args for non AVX2 CPU#5154
oobabooga merged 19 commits into
oobabooga:devfrom
adamflorizone:main

Conversation

@adamflorizone
Copy link
Copy Markdown
Contributor

@adamflorizone adamflorizone commented Jan 2, 2024

Adds other CPUs (such as non AVX2)

There is no other way to use "requirements_amd_noavx2.txt" without this fix.

Using "BUILD_REQUIREMENTS: requirements_noavx2.txt" will fix (llama.cpp) errors such as:

/entrypoint.sh: line 55:   348 Illegal instruction     (core dumped) python3 server.py ${CLI_ARGS}

Checklist:

@oobabooga
Copy link
Copy Markdown
Owner

That makes sense, thank you

@oobabooga oobabooga merged commit 894e1a0 into oobabooga:dev Jan 3, 2024
PoetOnTheRun pushed a commit to PoetOnTheRun/text-generation-webui that referenced this pull request Feb 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants